Skip to content

Add COMP 3000 Winter 2019 Final#67

Draft
qimcis wants to merge 188 commits intosys-intelligence:mainfrom
qimcis:comp3000-winter-2019-final
Draft

Add COMP 3000 Winter 2019 Final#67
qimcis wants to merge 188 commits intosys-intelligence:mainfrom
qimcis:comp3000-winter-2019-final

Conversation

@qimcis
Copy link
Collaborator

@qimcis qimcis commented Jan 18, 2026

Description

Add COMP 3000 Winter 2019 Final exam data and solution file to the repository and record exam metadata.

Changes

  • Add raw exam directory /home/qi/system-intelligence-benchmark/benchmarks/courseexam_bench/data/raw/comp3000_winter_2019_final with exam files.
  • Add solutions file comp3000-final-2019w-sol.pdf and link it to the exam metadata.
  • Record exam metadata: title "COMP 3000 Winter 2019 Final", exam ID comp3000_winter_2019_final, reference files: None.

Testing

Ran python3 courseexam/prepare.py to prepare and validate the exam data, completed without errors.

Checklist

  • Tests pass locally
  • Code follows project style guidelines
  • Documentation updated (if needed)

xuafeng and others added 30 commits November 5, 2025 18:10
…stinguish-api-keys

Distinguish the models used in the executor and evaluator
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
- Add gpt-4o model configuration to models.yaml
- Fix setup_tools.py to use shutil.move instead of os.rename
  This resolves 'Invalid cross-device link' error when /tmp is on different filesystem
tareknaser and others added 23 commits January 8, 2026 10:01
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
* modified the regular expression match

* added cs107_fall_2023_final

* updated one wrong tag

* Added pdf of the paper

* solved all the comments
* Add UIUC CS423 Fall 2025 Exams

* Fix json parsing

* Fix backtick

* Fix backtick 2

* Update benchmarks/courseexam_bench/data/cs_423_operating_systems_design_fall_2025_midterm/MP1.md

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update benchmarks/courseexam_bench/data/cs_423_operating_systems_design_fall_2025_final/exam.md

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Xuan Feng <xfeng9209@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…ce#54)

* add ostep processes-shell lab

* fix

* Update benchmarks/courselab_bench/data/cs537-projects-spring-2019/processes_shell/task.md

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Tarek Elsayed <60650661+tareknaser@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
* added cmu15-213 data lab

* docs(courselab): add note about infrastructure restrictions

Signed-off-by: Tarek <tareknaser360@gmail.com>

---------

Signed-off-by: Tarek <tareknaser360@gmail.com>
Co-authored-by: Tarek <tareknaser360@gmail.com>
* add cs537 fall 2021 final exam

* add institution

* fix

* add solutions

* update metadata

* add choice array

* avoid extra restrictions on LLM output

Signed-off-by: Tarek <tareknaser360@gmail.com>

---------

Signed-off-by: Tarek <tareknaser360@gmail.com>
Co-authored-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Copy link
Collaborator

@777lefty 777lefty left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just format issues about code blocks


If your program has the following code, what could it potentially output (depending upon the state of the system)? Assume that this code compiles with no warnings, and assume that you are running this as the user student.

e x e c v e ( ” / u s r / b i n / whoami ” , a r g v , NULL ) ;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There seems to be format issues like this, better eliminate the spaces and wrap it with code blocks

@qimcis qimcis force-pushed the comp3000-winter-2019-final branch from 843f2ff to 830f633 Compare January 26, 2026 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants